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ITERATIVE DECODING 



This nonprovisional application claims the benefit of U.S. provisional 
application No. 60/174,601 entitled "Map Decoding In Channels With Memory" filed on 
January 5, 2000. The Applicant of the provisional application is William Turin (Attorney 
5 Docket No. 105038). The above provisional application is hereby incorporated by 
reference including all references cited therein. 

BACKGROUND OF THE INVENTION 
1. Field of Invention 

This invention relates to iterative decoding of input sequences. 
10 2. Description of Related Art 

Maximum a posteriori (MAP) sequence decoding selects a most probable 
information sequence X^= (X\, X 2 , X T ) that produced the received sequence Y, T = 
(Yi, Y 2 , Yt). For transmitters and/or channels that are modeled using Hidden Markov 
Models (HMM), the process for obtaining the information sequence Xj that corresponds 
15 to a maximum probability is difficult due to a large number of possible hidden states as 
well as a large number of possible information sequences X[ . Thus, new technology is 
needed to improve MAP decoding for HMMs. 

SUMMARY OF THE INVENTION 
This invention provides an iterative process to maximum a posteriori (MAP) 
20 decoding. The iterative process uses an auxiliary function which is defined in terms of a 
complete data probability distribution. The MAP decoding is based on an expectation 
maximization (EM) algorithm which finds the maximum by iteratively maximizing the 
auxiliary function. For a special case of trellis coded modulation, the auxiliary function 
may be maximized by a combination of forward-backward and Viterbi algorithms. The 
25 iterative process converges monotonically and thus improves the performance of any 
decoding algorithm. 

The MAP decoding decodes received inputs by minimizing a probability of error. 
A direct approach to achieve this minimization results in a complexity which grows 
exponentially with T, where T is the size of the input. The iterative process avoids this 
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complexity by converging on the MAP solution through repeated use of the auxiliary 
function. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The invention is described in detail with reference to the following figures where 
like numerals reference like elements, and wherein: 

Fig. 1 shows a diagram of a communication system; 

Fig. 2 shows a flow chart of an exemplary iterative process; 

Figs. 3-6 show state trajectories determined by the iterative process; 

Fig. 7 shows an exemplary block diagram of the receiver shown in Fig. 1; 

Fig. 8 shows a flowchart for an exemplary process of the iterative process for a 
TCM example; and 

Fig. 9 shows step 1004 of the flowchart of Fig. 8 in greater detail. 
DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

Fig. 1 shows an exemplary block diagram of a communication system 100. The 
communication system 100 includes a transmitter 102, a channel 106 and a receiver 104. 
The transmitter 102 receives an input information sequence l[ (i.e., l u I 2 , I T ) of length 
T, for example. The input information sequence may represent any type of data including 
analog voice, analog video, digital image, etc. The transmitter 102 may represent a 
speech synthesizer, a signal modulator, etc.; the receiver 104 may represent a speech 
recognizer, a radio receiver, etc.; and the channel 106 may be any medium through which 
the information sequence Xf (i.e., Xi, X 2 , X T ) is conveyed to the receiver 104. The 
transmitter 102 may encode the information sequence ij and transmit encoded 
information sequence X[ through the channel 106 and the receiver 104 receives 
information sequence Y/" (i.e., Yi, Y 2 , Y T ). The problem in communications is, of 
course, to decode Yj T in such a way as to retrieve ij . 

Maximum a posteriori (MAP) sequence decoding is a technique that decodes the 
received sequence Y, T by minimizing a probability of error to obtain Xf (and if a model of 
the transmitter 102 is included, to obtain if). In MAP, the goal is to choose a most 
probable X[ that produces the received Yj T . The MAP estimator may be expressed by 
equation 1 below. 
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=argmaxPr(X[,Y, T ) (1) 
X ' 

where Pr(-) denotes a corresponding probability or probability density function and X[ is 
an estimate ofX^ . Equation 1 sets Xj to the that maximizes Pr(X^ , Y, T ). 

ThePrfc^Y, 7 ) term may be obtained by modeling the channel 106 of the 
communication system 100 using techniques such as Hidden Markov Models (HMMs). 
An input-output HMM X = (S,X,Y,7t,{P(X,Y)}) is defined by its internal states S = {1,2, 
. . .n}, inputs X, outputs Y 5 initial state probability vector n 9 and the input-output 
probability density matrices (PDMs) P(X,Y), XeX, YeY. The elements of P(X,Y), 
Pij(X,Y) = Pr(j 5 X ? Y | i), are conditional probability density functions (PDFs) of input x 
and corresponding output y after transferring from the state i to state j. It is assumed that 
the state sequences!) = (So, Si, S t ), input sequence Xj = (Xi,X 2 ,...X t ), and output 
sequence Y/ = (Yi,Y 2 ,. . .,Y t ) possess the following Markovian property 
Pr(S t ,X t ,Y t |s^X;-', Pr(S t ,X t ,Y t |S t _,). 

Using HMM, the PDF of the input sequence Xj and output sequence Y, T may be 
expressed by equation 2 below: 

T 

p T (X^,Y l T )=7cnP(X i ,Y i )l (2) 

where 1 is a column vector of n ones, % is a vector of state initial probabilities, and n is a 
number of states in the HMM. Thus, the MAP estimator when using HMM may be 
expressed by equation 3 below: 



X, r = argmax 



TinpcxuYoi 

i=1 



(3) 



The maximization required by equation 3 is a difficult problem because all 
possible sequences of X[ must be considered. This requirement results in a complexity 
that grows exponentially with T. This invention provides an iterative process to obtain 
the maximum without the complexity of directly achieving the maximization by 
evaluating equation 2 for all possible X ] , for example. In the iterative process, an 
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auxiliary function is developed whose iterative maximization generates a sequence of 
estimates for X[ approaching the maximum point of equation 2. 

The iterative process is derived based on the expectation maximization (EM) 
algorithm. Because the EM algorithm converges monotonically, the iterative process may 
improve the performance of any decoding algorithm by using its output as an initial 
sequence of the iterative decoding algorithm. In the following description, it is assumed 
that HMM parameters for the channel 106 and/or the transmitter 102 are available either 
by design or by techniques such as training. 

The auxiliary function may be defined in terms of a complete data probability 
distribution shown in equation 4 below. 

T 

^(z,X^,Y 1 T ) = 7C io rip il . )il (X t ,Y t ), (4) 

i=l 

where z = i J is an HMM state sequence, 71 iw is an initial probability vector for state io, 

and Pij(X,Y) are the elements of the matrix P(X, Y). The MAP estimator of equation 1 
can be obtained iteratively by equations 5-9 as shown below. 

X^ p+1 = argmaxQ(X^X^ p ) ? p = 0,1,2,... (5) 
x i 

where p is a number of iterations and Q( X| , X j p ) is the auxiliary function which may be 
expressed as 

Q(Xj , X^ p ) = £ ¥(z, Xj, , Y, T ) log(^(z, Xj , Y, T )). (6) 

z 

The auxiliary function may be expanded based on equation 4 as follows: 

Q(Xj ,Xl P ) = i Z I Y«.u( X Kp) log(Pij(X t , Y t )) + C (7) 

t=l i=l j=l 

where C does not depend on X^ , n is a number of states in the HMM and 

Yui (X^ p ) = a f (X!; 1 , Y,- 1 ) Pij (X l>p , Y, ) Pj (X^ , Y t T +I ) (8) 
where aj( X| p , Y, 1 ) and pj( X[ +1 p , Y t +, ) are the elements of the following forward and 
backward probability vectors 

T T 

a(X;,Y/) = 7T EI PCX^YO^ndPCXL^.D^IlPCX.YOl. (9) 

i=l i=t+l 
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Based on equations 5-9, the iterative process may proceed as follows. At p=0, an 
initial estimate of X[ 0 is generated. Then, Q(Xj 9 Xj j0 ) is generated for all possible 

sequences of . From equations 7 and 8, Q(X J ,X T ]0 ) may be evaluated by generating 
YUjCX^o) and log (py(X t ,Y t )) for each t, i, and j. Yt,ij(Xf 0 ) may be generated by using the 
5 forward-backward algorithm as shown below: 

a(XlX)=K> ^X^.Y^-aCXJi.Y/^PCX^.YJ ,t=l,2,...T 
P(X^ p5 Y T T +1 )=l, P(X; p ,Y>P(X Up ,Y,m^ 

Log (pjj(X t? Y t )) is generated for all possible X t for t=l, 2, T and the (X t )s that 
maximize D(X/",X^ 0 ) are selected asX^ . After X^ is obtained, it is compared with 

1 0 X^ 0 . If a measure D(X^, , X^ 0 ) of difference between the sequences exceeds a compare 
threshold, then the above process is repeated until the difference measure D(X^ p ,X^ r p _ 1 ) is 
within the threshold. The last X^ p for p iterations is the decoded output. The measure of 
difference may be an amount of mismatch information. For example, if X^ is a sequence 
of symbols, then the measure may be a number of different symbols between X^ p and 

15 X^p.i (Hamming distance); if X[ is a sequence of real numbers, then the measure may be 

an Euclidean distance D^X^,) = [^ 1 ( X i,P ~ X i, P -i) 2 ] ^ 

Fig. 2 shows a flowchart of the above-described process. In step 1000, the 
receiver 104 receives the input information sequence Y, T and goes to step 1002. In 
step 1002, the receiver 104 selects an initial estimate for the decode output information 
20 sequence X^ 0 and goes to step 1004. In step 1004, the receiver 104 generates Yt,ij(X^ p ) 

where p = 0 for the first iteration and goes to step 1006. In step 1006, the receiver 104 
generates all the log (pij(X t ,Y t )) values and goes to step 1008. 

In step 1008, the receiver 104 selects a sequence X^, that maximizes 

Q(X* p+I ,X* p )and goes to step 1010. In step 1010, the receiver 104 compares X^ p with 
25 X^p+i • If the compare result is within the compare threshold, then the receiver 104 goes 
to step 1012; otherwise, the receiver 104 returns to step 1004 and continues the process 
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with the new sequence X^ p+1 . In step 1012, the receiver 104 outputs Xj { and goes to 

step 1014 and ends the process. 

The efficiency of the above described iterative technique may be improved if the 
transmitted sequence is generated by modulators such as a trellis coded modulator 
(TCM). A TCM may be described as a finite state machine that may be defined by 
equations 10 and 1 1 shown below. 



Equation 10 specifies the TCM state transitions while equation 1 1 specifies the 
transmitted information sequence based on the state and the input information sequence. 
For example, after receiving input I t in state S t , the finite state machine transfers to state 
S t +i based on S t and I t as shown in equation 10. The actual output by the transmitter 102 
is X t according to equation 11. Equation 10 may represent a convolutional encoder and 
equation 1 1 may represent a modulator. For the above example, the transmitter output 
information sequence Xf may not be independent even if the input information 
sequence if is independent. 

In equation 15, the log(pij(Y t ,X t )) term may be analyzed based on the TCM state 
transitions because the information actually transmitted X t is related to the source 
information I t by X t = g t (S t5 I t ). This relationship between X t and I t forces many elements 
py(Y t ,X t ) of P (Y t ,X t ), to zero since the finite state machine (equations 10 and 1 1) 
removes many possibilities that otherwise must be considered. Thus, unlike the general 
case discussed in relation to equations 5-9, evaluation of pij(Y t ,X t ) may be divided into a 
portion that is channel related and another portion that is TCM related. The following 
discussion describes the iterative technique in detail for the TCM example. 

For a TCM system with an independent and identically distributed information 
sequence, an input-output HMM may be described by equations 12 and 13 below. 



S t +i - /t(S t5 I t ) 
X t = gt(S t , I t ) 



(10) 

(11) 




(12) 



where 




0 otherwise 



Pr(I,)if S, +l = f t (S t ,I t ) 



(13) 
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P c (Y t | X t ) is the conditional PDM of receiving Y t given that X t has been transmitted for 
the HMM of a medium (channel) through which the information sequence is 
transmitted; p s s +j is the probability of the TCM transition from state S t to state S t +i, and 
Pr(It) is the probability of an input I t . Thus, equation 2 may be written as 

T 

p T (I l r ,Y 1 T )=7 tc np S(S , + P c (Y,| X,)l, 

i=l 

where 7C C is a vector of the initial probabilities of the channel states, X t = g t (S t ,I t ), and the 
product is taken along the state trajectory S t +i = f t (S t ,I t ) for t = 1, 2,...,T. 

If all elements of the input information sequence are equally probable, then the 
MAP estimate may be expressed by equation 14 below. 

i[=argmax7t c nP c (Y t |X t )l, (14) 
11 t=i 

The auxiliary function may be expressed by equations 15-17 below corresponding to 
equations 7-9 above. 

Q(lJM P )-i Z Z Yuj(I^ p )log(pij(Y t |x t )) + C (15) 

t=1 i=l j=l 

where X t = g t (S t ,I t ) and 

Y,,^,,) = o i (Y, M I i;, p )Pc,ij(Y t |x t>p )Pj(Y t T +liP | I*,,) (16) 

a { (Yj 7-1 1 1 J ~ 1 ) and (3 • (Y t T +1 p I 7 +I p ) are the elements of the forward and backward 
probability vectors 

Ct(Y;|i;)= 7C c nP c (Y i |X i )andP(Y t T +I |l 7 l )= El Pc(Y 8 |x s )l (17) 

i=| ' i=t+l 1 

From equation 15, the Viterbi algorithm may be applied with the branch metric 

ii n 

m(l.)=Z X Yujfcp) lo gPc,u(Y t |X t ), t = l,2,...,T (18) 



rT T T 



to find a maximum of Q(I, ,1, p ) which can be interpreted as a longest path leading from 

the initial zero state to one of the states S T where only the encoder trellis is considered. 
The Viterbi algorithm may be combined with the backward portion of the forward- 
backward algorithm as follows. 
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1 . Select an initial source information sequence I ^ 0 = 1 , 0 , 1 2 0 5 . . . ,1 T 0 

2. Forward part: 

a. set a( Y,° | I?) = 7C 5 where 71 is an initial state probability estimate; 

and 

b. for t = 1 ? 2 5 . . .,T, compute X tjP = g t (S t ,I t , P ), 
aCY/llI^-aCY;- 1 |i;i)P c (Y t |x,, p ) 3 

where I J is a prior estimate of 1} . 

3 . Backward part: 

a. set p {Yj +] |I^ +1jP ) = 1 and last state transition lengths L(St) to 0 
for all the states; 

fort = T,T-l, ... 5 1 compute: 

b. X t = g t (S t ,I t ), 

YMjfep)=«i(Y 1 t - 1 ii;;;)pcj (v t ixjft (Y t T +! |i; +1 J 5 

d. L(S t )=max {L[f t (s t ,I t )J+m(l t )}. This step selects the paths with 

i, 

the largest lengths (the survivors). 

e. I t (S t )=argmax{L[f t (S t ,I t )]+m(l t )}. This step estimates I t 

corresponding to the state S t by selecting the I t of the survivor in step d. 
f- P(Y t T IO = Pc(Y,|x t , p )P(Y 1 T +1 |X^„). 

g. End (of "for" loop). 

4. Reestimate the information sequence: 

I t, P +i =it(S,), S t+I =f t (S,,I, p+1 ), t = l,2,...,T where S,=0;and 

5. If I, p+I I, p , go to step 2; otherwise decode the information sequence as 



I 



T 

t,p+l 
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Figs. 3-6 show an example of the iterative process discussed above where there 
are four states in the TCM and T = 5. The dots represent possible states and the arrows 
represent a state trajectory that corresponds to a particular information sequence. The 
iterative process may proceed as follows. First, an initial input information sequence 
5 if 0 is obtained. I* 0 may be the output of an existing decoder or may simply be a guess. 

The Viterbi algorithm together with the backward algorithm may be used to 
obtain a next estimate of the input information sequence I f , . This process begins with 

the state transitions between t = 4 and t = 5 by selecting state transitions leading to each 
of the states s0-s3 at t = 4 from states at t = 5 that have the largest value of the branch 
10 metric L(S4) = m(I 5 ) of equation 18 above. Then, the process moves to select state 

transitions between the states at t = 3 and t = 4 that have the largest cumulative distance 
L(S3) = L(S4) + m(I 4 ). This process continues until t = 0 and the sequence of input 
information I* corresponding to the path connecting the states from t = 0 to t = 5 that has 

5 

the longest path L(So) = ^ m(I t ) is selected as the next input information sequence I f , . 

t=i 

15 For the example in Fig. 3, state transitions from the states at t = 4 to all the states 

at t = 5 are considered. Assuming that the (I t )s are binary, then only two transitions can 
emanate from each of the states at t = 4: one transition for I 5 = 0 and one transition for I 5 
= 1 . Thus, Fig. 3 shows two arrows terminating on each state at t = 4 (arrows are 
"backwards" because the backward algorithm is used). State transitions 301 and 302 

20 terminate at state sO; state transitions 303 and 304 terminate at state si ; state transitions 
305 and 306 terminate at state s2; and state transitions 307 and 308 terminate at state s3. 

The branch metric m(I t ) of equation 18 represents a "distance" between the states 
and is used to select the state transition that corresponds to the longest path for each of 
the states s0-s3 at t = 4: 

25 m(I 5 ) =2 5>Jj(X?, ) log Pij(X 55 Y 5 ) 

< i 

=11^ X 4 , 0 , Y, 4 ) Pij (X5,o,Y 5 )pj( X^ 0 , Y 6 5 )log Pij (Y 5 1 X 5 ), (19) 
' j 

where Pj( X^ 0 , Y 6 5 ) = 1, and X 5 = g 5 (S 5 , 1 5 ) by definition. There is an I5 that corresponds 
to each of the state transitions 301-308. For this example, L(S 4 ) = m(I 5 ) corresponding to 
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odd numbered state transitions 301-307 are greater than that for even numbered state 
transitions 302-308. Thus, odd numbered state transitions are "survivors." Each of them 
may be part of the state trajectory that has the longest path from t = 0 to t = 5. This 
transition (the survivor) is depicted by the solid arrow while the transitions with smaller 
lengths are depicted by dashed lines. 

The state sequence determination process continues by extending the survivors to 
t = 3 as shown in Fig. 4 forming state transitions 309-316. The distance between state 
transitions for each of the states are compared based on L(S 4 ) + m(I 4 ), where m(L0 is 
shown in equation 20 below. 

m (W = Z 2>,ij(X? i0 ) log Pij(X4,Y 4 ) 
« j 

=X X «i( K > Y i 3 )Pij(X4,o,Y 4 )Pj( X 50 , Y 5 )log Pij (Y 4 I X4). (20) 

» j 

For this example, the distances corresponding to the odd numbered state transitions 309- 
315 are longer than distances corresponding to even numbered state transitions 310-316. 
Thus, the paths corresponding to the odd numbered state transitions are the survivors. As 
shown in Fig. 4, the state transition 301 is not connected to any of the states at t = 3 and 
thus is eliminated even though it was a survivor. The other surviving state transitions 
may be connected into partial state trajectories. For example, partial state trajectories are 
formed by odd numbered state transitions 307-309, 303-31 1, 303-313 and 305-315. 

The above process continues until t = 0 is reached as shown in Fig. 5 where two 
surviving state trajectories 320-322 are formed by the surviving state trajectories. All the 
state trajectories terminate at state zero for this example because, usually, encoders start 
at state zero. As shown in Fig. 6, the state trajectory that corresponds to the longest 
cumulative distance is selected and the input information sequence if (via S t +i = f t (S t ,I t ) 
that corresponds to the selected trajectory is selected as the next estimated input 
information sequence If , . For this example, the state trajectory 320 is selected and the 

input information sequence if corresponding to the state trajectory 320 is selected as if , . 

Fig. 7 shows an exemplary block diagram of the receiver 104. The receiver 104 
may include a controller 202, a memory 204, a forward processor 206, a backward 
processor 208, a maximal length processor 210 and an input/output device 212. The 



Docket No. 1999-0078 11 

above components may be coupled together via a signal bus 214. While the receiver 104 
is illustrated using a bus architecture, any architecture may be suitable as is well known to 
one of ordinary skill in the art. 

All the functions of the forward, backward and maximal length processors 206, 
5 208 and 2 1 0 may also be performed by the controller 202 which may be either a general 
purpose or special purpose computer (e.g., DSP). Fig. 7 shows separate processors for 
illustration only. The forward, backward maximal length processors 206, 208 and 210 
may be combined and may be implemented by using ASICs, PLAs, PLDs, etc. as is well 
known in the art. 

1 0 The forward processor 206 generates the forward probability vectors 

oti (xj"p , Y, M ) herein referred to as otj. For every iteration, when a new X^ p (or 1^ ) is 

generated, the forward processor 206 may generate a complete set of a x . 

The backward processor 208 together with the maximal length processor 210 
generate a new state sequence by searching for maximal length state transitions based on 
1 5 the branch metric m(I t ). Starting with the final state transition between states 

corresponding to t = T - 1 and t = T, the backward processor generates (3j( X^, , Y t +, ) 

(hereinafter referred as pj) as shown in equation 8 for each state transition. 

The maximal length processor 210 generates m(I t ) based on the results of the 
forward processor 206, the backward processor 208 and pij(X t ,Y t ). After generating all 
20 the m(I t )s corresponding to each of the possible state transitions, the maximal length 
processor 210 compares all the L(S t ) + m(I t )s and selects the state transition that 
corresponds to the largest L(S t ) + m(I t ), and the I t (via S t +i = f t (S t , I t )) that corresponds to 
the selected state transition is selected as the estimated input information for that t. The 
above process is performed for each t = 1, 2, T to generate a new estimate ij for each 
25 of the iteration p. 

Initially, the controller 202 places an estimate of the PDM P(X,Y) and 7t in the 
memory 204 that corresponds to the HMM for the channel 106 and/or the transmitter 102. 
The PDM P(X, Y) may be obtained via well known training processes, for example. 

When ready, the controller 202 receives the received input information sequence 
30 Y, T and places them in the memory 204 and selects an initial estimate of I^ 0 (or X^ 0 ). 
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The controller 202 coordinates the above-described iterative process until a new estimate 
1^ (or X^, ) is obtained. Then, the controller 202 compares I^ 0 with I*, to determine if 

the compare result is below the compare threshold value (e.g., matching a predetermined 
number of elements or symbols of the information sequence). The compare threshold 
may be set to 0, in which case I* 0 must be identical with 1^, . If an acceptable compare 

result is reached, 1^, is output as the decoded output. Otherwise, the controller 202 
iterates the above-described process again and compares the estimated lj ? with ij t 
until an acceptable result is reached and 1^ is output as the decoded output. 

Fig. 8 shows a flowchart of the above-described process. In step 1000, the 
controller 202 receives Y, T via the input/output device 212 and places Y, T in the memory 
204 and goes to step 1002. In step 1002, the controller 202 selects an initial estimate for 
I^ 0 and goes to step 1004. In step 1004, the controller 202 determines a new state 

sequence and a next estimated 1^, (I^ p , where p = 1) (via the forward, backward and 
maximal length processors 206, 208 and 210) and goes to step 1006. In step 1006, the 
controller 202 compares I^ 0 with 1^, . If the compare result is within the predetermined 
threshold, then the controller 202 goes to step 1008; otherwise, the controller 202 returns 
to step 1004. In step 1008, the controller 202 outputs I^ p where p is the index of the last 
iteration and goes to step 1010 and ends the process. 

Fig. 9 shows a flowchart that expands step 1004 in greater detail In step 2000, 
the controller 202 instructs the forward processor 206 to generate otj as shown in 
equation 8, and goes to step 2002. In step 2002, the controller 202 sets the parameter 
t = T and goes to step 2004. In step 2004, the controller 202 instructs the backward 
processor 208 to generate pj and the maximal length processor 210 to determine next set 
of survivors based on equation 18 and time t+1 survivors and goes to step 2006. 

In step 2006, the controller 202 decrements t and goes to step 2008. In step 2008, 
the controller 202 determines whether t is equal to 0. If t is equal to 0, the controller 202 
goes to step 2010; otherwise, the controller 202 returns to step 2004. In step 2010, the 
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controller 202 outputs the new estimated 1^ and goes to step 2012 and returns to 
step 1006 of Fig. 5. 

A specific example of the iterative process for convolutional encoders is enclosed 
in the appendix. 

While this invention has been described in conjunction with specific embodiments 
thereof, it is evident that many alternatives, modifications, and variations will be apparent to 
those skilled in the art. Accordingly, preferred embodiments of the invention as set forth 
herein are intended to be illustrative, not limiting. Various changes may be made without 
departing from the spirit and scope of the invention. 

For example, a channel may be modeled as P C (Y | X) = P C B C (Y | X) where P c is a 
channel state transition probability matrix and B C (Y | X) is a diagonal matrix of state 
output probabilities. For example, based on the Gilbert-Elliott model 



1-b 



0 



b x .0 
0 b 2 \' 



B C (X|X) = 



0 l-b 2 



andB c (X |X) = 



where X is the complement of X. For this case, m(I t ) may be simplified as 



m(It) = Z Yu(^ p )bj(Y t | X t ), t = 1, 2, T, and 



Y U (I^ p ) = ai(Y; | Il iP )|3i(Y t T + , | p ), where bj(Y t | X t ) are the elements of 
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